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B. 

struct shm.tspkt { 

data_byte 188byte Packet data 

} 


C 

struct shm_apkt { 
DWORD sync_code 
WORD pts 
WORD frame_length 
BYTE data_byte 


32bit Packet synchronous code 
16bit Display time 
16bit Frame length 
Nbyte Sound data 

(N=f rame_l ength) 


D. 

struct shm_vpkt { 
DWORD sync_code 
BYTE temporal_ref erence 
WORD frame_l ength 
BYTE data_byte 


32bit Packet synchronous code 
8bit Frame number 
16bit Frame length 
Nbyte Picture data 

(N=frame_length) 


E. 

struct shn_kanshi_lnfo { 

WORD pts 16bit Display time 

BYTE number_of_object 8bit No. of objects 
for (i=0: i<number_of_object:i++) { 


BYTE 

object_id 

8bit 

ID 

BYTE 

temporal_ref erence 

8bit 

Frame number 

BYTE 

objectjpriority 

4bit 

Priority (*1) 


reserved 

2bit 



IPB_flag 

2bit 

Frame type 

WORD 

horizontal_offset 

lObit 

Display position, horizontal 

WORD 

ver t i cal_of f set 

lObit 

Display position, vertical 

BYTE 

layer 

4bit 

Layer 


(* 1 ) Bits are assigned from the highest position sequentially by 4 bits 
(object_priority), 2 bits, 2 bits (IPB_flag) 
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Fig. 6 

DEMUX thread 

void demux ( ) 
{ 

Shared memory (ring), semaphore generation process: for output 

(2 for sound, 3 for picture, 1 for monitor table) 
Semaphore generation for monitor thread control (one) 
BOOL flag = TRUE: // State of ring buffer 

while (1) { 

if (flag) Reading from file or network - (5-1) 
if (flag) 

Analysis of 188-byte packet data, setting in specified structure - (5-2) 
(decomposed into information of sound, picture, monitor table) 

// Exclusive control of ring buffer by semaphore 
i f (Able to write in ring buffer ?) { 

Write into ring buffer (from earlier object ID, write sequentially - (5-3) 
into shared memory of earlier buffer number) 

Advance write pointer of written buffer - (5-4) 

flag=TRUE: 
}else 

f lag=FALSE : // Prevent overflow of ring buffer 
if (flag) 

After writing information of pictures and sounds for one monitor - (5-5) 
table, advance the counter of semaphore for monitor thread control 


} 
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Fig. 7 

Monitor thread 

void Watch Process ( ) 
{ 

BYTE disp_TR [i] : // Picture serial number (shared memory) 
BOOL skip_f lag [i] : // Skip flag to which decoding process refers 

(shared memory) 

Shared memory (ring buffer: monitor table 1) 

Semaphore open: used by determining priority of processing 
Shared memory (single buffer: monitor table 1) 

Semaphore generation: transfer to synthesis side 
Generation of semaphore for process monitor 
Semaphore open for monitor thread control (one) 

Start of picture decoding process 
Confirm start of process 

while {skip__flag[i] =FALSE: // Not skipped } 

while (1) 
{ 

Reading of monitor table (read pointer update, from DEMUX) 
Check of object priority - (6-1) - (5-2) 

Writing of monitor table (to synthesis side) - (6-3) 

Wait for creation of data for one monitor table from DEMUX - (6-4) 

From highest priority 
{ 

disp_TR[i] =TR: -(6-5) 

if ( Present time > display time (pts) ) { - (6-6) 

Not skipped if I frame 

f ski P _flag[i]=FALSE 
}else{ 

P, B frames are skipped 
^ skip_flag[i]=TRUE 

Release of semaphore of corresponding process - (6-7) 

Wait for release of semaphore of corresponding process - (6-8) 

(process completion check) 


hi S 
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Fi go 8 

Decoding process 

void main (int argc, char °argv [ ] ) 

{ 

Value received from main process : 

Shared memory to be opened, name of semaphore 

Shared memory (ring), open processing of semaphore: for input (from MUX) 
Shared memory (single), open processing of semaphore: for output (to synthesis 

side) 


Si while (1) { 

yi Monitor thread waits for release of semaphore - (7- 1 ) 


Input picture state check: - (7-2) 

Picture serial number (TR), skip input frame? 

Wait for picture data to be decoded - (7-3) 


Sj Is TR present in shared memory? { - (7-4) 

Skip decoding if not present 
Advance read pointer for ring buffer (for input) 

} 

if (Skip one input frame) { 

Decoding process - (7-5) 

Advance read pointer for ring buffer (for input) 

} 

Output of decoding result (* 1 ) - (7-6) 

Release semaphore to monitor thread (process end notice) - (7-7) 

} 

} 

(*1) When skipping input frame process, send signal to main process without 
decoding process and output of decoding result 
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Picture synthesis thread 
void Watch Sync ( ) 

{ 

Shared memory (single), semaphore generation process: for input (from decoder) 
Shared memory (single), semaphore generation process: for input (from monitor 

thread) 

Shared memory (single), semaphore generation process: for output (to display 

monitor: 2) 

BOOL flag=TRUE: 
while (1) { 

Wait for monitor table from monitor thread - (8- 1 ) 

in Check priority order of object - (8-2) 

From highest priority order { - (8-3) 

Wait for picture of decoding result (accumulated in shared memory) 
// Totally black if empty 

} 

Synthesis of image adjusting to display position - (8-4) 


gi // Double buffer 


if (flag) { »(8-5) 
Write synthesis result into shared memory (to display monitor) #1 
flag=FALSE: 
} else { 

Write synthesis result into shared memory (to display monitor) #2 
flag=TRUE: 

} 


# 


09/051547 


F i go 10 


10/16 


Display monitor thread 


void fetch Disp ( ) 
{ 

Shared memory (single), open processing of semaphore: for input 

(from synthesis thread: 2) 

BOOL flag = TRUE: 


while (1) 
{ 

// Double buffer 
if (flag) { 

Wait for synthesis picture from shared memory (from synthesis thread)#l 
flag = FALSE: -(9-1) 
} else { 

Wait for synthesis picture from shared memory (from synthesis thread) #2 
flag = TRUE: 

} 


if (Initial display) { 

Acquire display start time from timer - (9 - 2 ) 

} 

Sleep (pts-nowtime) : - (9-3) 

Display of synthesis picture 

} 

} 
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Fig. 11 
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Fig. 12 (a) 
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Fig. 12 (b) 
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O Feedback relating to response between transmission terminal and reception 
terminal (case 1) 


Transmission side terminal 


Reception side terminal 


Transmission of picture 


Response right after reception 
or response after reproduction 


Completion of processing 
of reception or reproduction 


Check of response time 
(adjust quantization step, 
number of frames, etc.) 


Time 


O Feedback of reproduction situation to transmission side terminal (case 2) 
Transmission side terminal Reception side terminal 


Picture 1 (transmission) 
Picture 2 (transmission) 
Picture 3 (transmission) 
Sound 1 (transmission) 


Reproduction process 
(Reproduction of pictures 1, 2, sound 1) 


.Transmission of reproduction result' 


(Reproduction of pictures 1, 2, sound 1) 
Compression process of picture 3 stands by. 


i 


Time 


